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Abstract 

Decadal climate predictions, which are initialized with observed conditions, are characterized by two 
main sources of uncertainties-internal and model variabilities. Using an ensemble of climate model sim¬ 
ulations from the CMIP5 decadal experiments, we quantified the total uncertainty associated with these 
predictions and the relative importance of each source. Annual and monthly averages of the surface tem¬ 
perature and wind components were considered. We show that different definitions of the anomaly results 
in different conclusions regarding the variance of the ensemble members. However, some features of the 
uncertainty are common to all the measures we considered. We found that over decadal time scales, there 
is no considerable increase in the uncertainty with time. The model variability is more sensitive to the an¬ 
nual cycle than the internal variability. This, in turn, results in a maximal uncertainty during the winter in 
the northern hemisphere. The uncertainty of the surface temperature prediction is dominated by the model 
variability, whereas the uncertainty of the wind components is determined by both sources. Analysis of the 
spatial distribution of the uncertainty reveals that the surface temperature has higher variability over land 
and in high latitudes, whereas the surface zonal wind has higher variability over the ocean. The relative 
importance of the internal and model variabilities depends on the averaging period, the definition of the 
anomaly, and the location. These findings suggest that several methods should be combined in order to 
assess future climate prediction uncertainties and that weighting schemes of the ensemble members may 
reduce the uncertainties. 
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I. INTRODUCTION 


Decadal climate predictions usually refer to predictions on time scales of one to three decades 
KMll. The meaningful products of these climate simulations are the averages of the climate vari¬ 
ables over periods in the range of months to several years. Accurate predictions of these temporal 
averages for several decades are of great interest to decision makers, agricultural producers and 
other stakeholders. However, useful predictions must be accompanied by a measure of the un¬ 
certainty, i. e., the range of likely values of the predicted variables. A common approach for 
estimating these uncertainties is by means of an ensemble of climate models Il9l-l34ll. 

On decadal time scales, uncertainties can be attributed to two main sources-internal and model 
variabilities [[32]]. Internal variability is the spread of the climate predictions of the same climate 
model initialized with different, equally realistic, initial conditions (different realizations). Model 
variability is the spread of the climate predictions of different models (we also include in this defi¬ 
nition the sensitivity of each model to the various parameters). A third source of uncertainty, which 
is more relevant in longer time scale predictions, is the scenario uncertainties. These uncertain¬ 
ties reflect the variance of each model’s climate predictions due to different projected atmospheric 
composition changes in the future. Whereas internal variability is considered as an inherent noise 
of the climate models, which can hardly be reduced by ensemble methods, the model variability 
may be reduced ll^ by weighting the ensemble models (e.g., based on their past performance) 
ll35]l . Therefore, quantification of the relative importance of each of these sources may be used to 
estimate the minimal uncertainties that can be achieved. A good forecast is one for which the Root 
Mean Square Error (RMSE) of the prediction is equal to the uncertainty associated with the pre¬ 
diction ll3^ . A forecast that has lower uncertainty than the RMSE is considered as overconfident. 

Decomposing the uncertainty into its components should be done by using a reliable climate 
model ensemble composed of different realizations, models and scenarios; however, these are not 
always available. Different methods have been used to overcome the limited amount of data. The 
role of internal variability in the uncertainties of the CMIP2’s (Coupled Model Intercomparison 
Project Phase 2) long-term climate projections was investigated ifTTIl . However, that data includes 
only one realization for each of the climate models. Therefore, the internal variability was es¬ 
timated from the variance of segments of equal duration. An analysis of global scale data ifTTll 
was extended to regional scales for surface temperature and precipitation using an ensemble taken 
from the CMIP3 experiment 1^ . This data also includes one realization for each model. 
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To estimate the internal variability, they fitted the predictions of each of the models to a fourth 
degree polynomial, and the internal variability was defined as the variance of the differences be¬ 
tween the polynomial fit and the model predictions. They showed that for the next few decades, 
the main sources of uncertainty are the model and the internal variabilities. The uncertainties in 
climate predictions from the CMIP3 were decomposed in ll3^ . In this analysis a full ensemble 
was used, including different models, different realizations of each model, and different scenarios, 
to decompose the prediction uncertainties into four components: internal, model, scenario and 
model-scenario interaction uncertainty. The fourth component, which did not exist in the previous 
works mentioned, arose because of their definition of model and scenario uncertainties, which 
resulted in an interaction term. 

The works discussed above (and others) describe the uncertainties of long-term climate projec¬ 
tions. The common practice in these simulations is to initialize the climate models with a quasi¬ 
equilibrium steady state under a preindustrial atmospheric composition and to let them run into 
the future (usually until 2100) with observed past atmospheric composition changes and differ¬ 
ent scenarios for the future atmospheric composition changes. In these experiments, the outputs 
of interest are the 10-year (or longer) averages of the climate variables. The main interest is in 
estimating the response of the climate system to different atmospheric composition change sce¬ 
narios. However, annual (or shorter period) averages of the climate variables are not expected to 
be synchronized with observations since they are initialized long before the present with somewhat 
arbitrary conditions Il37l . Therefore, a high resolution time series of the uncertainty derived from 
these projections is also not expected to be synchronized with the projections. 

Here, we studied the uncertainties associated with near-term climate predictions, namely, 
decadal climate predictions from the CMIP5 (381. The ensemble considered is composed of dif¬ 
ferent models and realizations. This enables us to assess the relative importance of the internal and 
model variabilities. The variables investigated here are the surface temperature (T) and the surface 
zonal wind ((7). The surface meridional wind (V) was found to have similar characteristics to 
those of U, and therefore, the results of its analysis are provided in the Supplementary Materials. 
The period of interest, 2006-2036, was chosen simply because it is the last decadal experiment of 
the CMIP5 that provides predictions for 30 years. A list of the climate models (and the number of 
realizations of each model) included in the ensemble we analyzed is presented in Table |I| 

The decadal climate simulations, unlike the CMIP5 long-term experiments, are initialized with 
observed ocean and sea ice conditions and, therefore, are expected to be synchronized with the 
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TABLE I: The CMIP5 decadal experiment models and the number of realizations for each of the models. 


Model 

T 

U/V Resolution 

bcc-csml-l 

4 

4 

64X128 

CanCM4 

20 

20 

64X128 

CMCC-CM 

3 

3 

240X480 

FGOALS-g2 

3 

- 

60X128 

FGOALS-S2 

3 

3 

108X128 

HadCM3 

10 

10 

73X96 

IPSL-CM5A-LR 6 

6 

96X96 

MIROC4h 

6 

6 

320X640 

MIROC5 

6 

6 

128X256 

MPI-ESM-LR 

3 

3 

96X192 

MRI-CGCM3 

3 

3 

160X320 


climate system. The time series of the uncertainty is also expected to be synchronized with the 
predictions. Decadal climate predictions were shown to produce a limited skill globally and a 
better skill in specific regions llTSlI^I^ . 


II. DECOMPOSING UNCERTAINTIES TO COMPONENTS 

The CMIP5 decadal predictions include different models and several realizations of each 
model. The effect of different scenarios is not significant over a decadal time scale, and there¬ 
fore, different scenarios are not considered. The method we use to decompose the sources of 
uncertainties is similar to those presented in ifTTlI^ . We decompose the uncertainty into its two 
main sources-internal and model variabilities. Unlike previous studies li3^ . we define the model 
and internal variabilities to be independent, and therefore, we do not have a model-internal “inter¬ 
action” term. 

For each time step and grid cell, we define the total variability of the ensemble predictions as 
the weighted ensemble variance, that is: 
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where Xm,rm is predictions of the climate variable x by the realization of model m, Wm,rm 
is its corresponding weight, Xjn,- is the average of the realizations of model m, x.^. is the ensemble 
average (average of all the realizations and models), N is the number of models and N^n is the 
number of realizations of model m. The last line in equation is zero by definition, and therefore, 
equation!^ reads: 
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This defines the two uncoupled contributions to the total variability, internal variability, erf, and 
model variability, cr|^. For N models and Nm realizations of model m, we also define Wm,r = 
jy ]y to avoid bias toward models with higher numbers of realizations. Equation can then be 
slightly simplified: 
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III. DEFINITION OF THE ANOMALY 

It is known that climate models suffer from systematic bias, and a common practice is to correct 
their bias using different methods iH SH |42|]. A simple, and the most frequently used, method 
is to subtract a constant factor (a different factor for each model), calculated from a reference 
period, from the predictions and analyze the spread of the anomalies. In the long-term climate 
projections, it is the historical part of the experiment that is commonly used as a reference period. 
The decadal experiments, on the other hand, do not have such a trivial historical reference period, 
and the definition of the anomalies is not trivial. Moreover, it is also known that climate models 
initialized with observed conditions tend to drift to their preferred physical state during the first 
years after the initialization |l8l|37]|. This fact further complicates the bias correction methods for 
these experiments. 

Here, we consider two different definitions of the anomaly, which differ by the choice of the 
reference period and data. The first, and the most intuitive, approach is to consider the predictions 
without any bias corrections. In order to easily visualize the data, a common factor (the same 
factor for all models and for all times) is subtracted from the predictions, that is: 

(t) = Yra,r (t) - X {t TTlod 12) , (4) 

where Ym,r (t) is the prediction of the rth realization of model m for time t (in our analysis, t 
measures a discrete number of months, and the variable Y is either the surface temperature, T, or 
the surface zonal wind, U) and X (i) is the climatological average of month z (z e [0,11]; z = 0 
corresponds to December and z = 1... 11 correspond to January-November, respectively) of the 
climate variable Y. The climatology used in this work is based on the NCEP reanalysis data ll^ 
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FIG. 1: Global averages of (a) and (b) as predicted by the models of the ensemble (averaged over 
the realizations). The values represent the predicted values minus a reference climatology derived from the 
NCEP reanalysis data for the period of 1976-2006. The factor subtracted is identical for all the models and, 
therefore, does not represent a bias correction. 

for the period 1976-2006. In what follows, we refer to this definition as the dm anomaly and use 
the superscript c to denote it. 

Figure shows the annual and global averages of and as predicted by the climate models 
in the ensemble (averaged over the realizations). The NCEP reanalysis data for the first seven 
years is also presented for reference. Note that this is not a bias correction method since the same 
constant factor is removed from all the models. 

As can be seen in the figure, most of the models predict an increase of with time. Some of 
the models do show a decrease of T'^ during the first few years; this decrease can be associated 
with the drift from the initial condition to the model physics. The spread of the model predictions 
also seems to increase with time but not substantially (see also the left column in Table |Ip. The 
zonal surface wind, U^, does not show any apparent trend in the data or in the spread of the model 
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TABLE II: The trends of the ensemble average and the spread for surface temperature (T) and surface 
zonal wind (U). The trends are provided for the two definitions of the anomaly considered-no corrections 
anomaly (elm) and the bias correction anomaly (bias). Note that by definition, the trend of the ensemble 
average is the same for the two definitions of the anomaly. 



Variable 

elm 

bias 

Trend of 

ensemble mean 

T [°Cy-^] 

0.023 

0.023 


U [ms~^y~^] 

2.4 X 10-3 

2.4 X 10-3 

Trend of model 

spread 

T [°Cy-^] 

0.0069 

0.0031 


U [ms~^y~^] 

8.3 X 10“® 

-1.8 X 10-3 


predictions. In addition, none of the models show a drift toward different physics, except for the 
CAN-CM4 model, which predicts an increase of the zonal wind during the second year of the 
simulation and then smaller fluctuations around that value. 

The second definition of the anomaly refers to the deviation of each model from its own clima¬ 
tology during some reference period. This definition removes the problems due to known biases 
of the models. However, the predictions are only meaningful if one assumes that other characteris¬ 
tics of the climate variables (e.g., higher moments and extreme events) are not altered by the bias. 
Here, the reference period for calculating the climatology of each model was the last twenty years 
of the simulations, i.e., 2016-2036. This choice of the reference period is expected to remove 
the effects of the drift from the initial condition toward the model physics We refer to this 
anomaly definition as the bias anomaly and denote it with the b superscript; the definition reads: 

(t) = (t) - (t mod 12). (5) 

Here, (i) is the 2016-2036 average during month i (i e [0,11]; z = 0 corresponds to Decem¬ 
ber and i = 1... 11 correspond to January-November, respectively) of the climate variable Y as 
predicted by the realization r of model m. This definition does not rely on the assumption that the 
quality of the prediction depends mainly on the lead time ll^ and is similar to the bias correction 
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FIG. 2: Global averages of (a) and (b) as predicted by the models of the ensemble (averaged over 
the realizations). The curves present the predicted values minus the 2016-2036 climatology of each model. 
The factor subtracted is different for each model and represents a bias correction. 

suggested in ll44ll for anomaly-initialized models (see also ifSil). 

The bias anomaly of the models is plotted in Figure |^for and (7^. The panel shows that 
this definition of the anomaly highlights the effects of the model drift. During the first few years, 
some of the models drift to their preferred physical state, and then, they all predict an increase in 
the global temperature. U^, just like U^, does not show a considerable trend (see the right column 
in Table |II]). Following the drift period, the spread of the model anomalies is much smaller than 
the spread of the dm anomalies. This is not surprising because the bias anomaly removes from 
each model its average, thereby bringing the model anomalies closer to each other. 

We would like to mention two points in favor of the first definition of the anomaly (dm) that 
does not involve a bias correction. Uncertainties and predictions derived from the dm anomaly 
do not rely on the assumption that the characteristics of the climate variables are not altered by 
the biased climate simulated by the models. Clearly, the bias correction methods only correct the 
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first moment (the mean) of the variable. Higher moments are likely to be altered in the simulated 
biased climate. In addition, the dm anomaly provides an equally good estimate of the uncertainty 
at all times and does not favor the period long after the initialization of the models. A point in 
favor of the the second method (bias) is the forecast reliability. A quick look at Figure [T] reveals 
that the variability of the models is much larger than the mean square error of the ensemble mean. 
For the bias anomaly, we can see in Figure that after the drift of the models during the first 
years of the simulations, the mean square error is close to the variability of the models, thereby 
allowing us to consider the ensemble mean of this anomaly as a reliable forecast ll^ . Since there 
is no straightforward solution to the question regarding which of the definitions of the anomaly is 
better, we will present the uncertainties for both anomalies. 


IV. GLOBAL PROPERTIES OF THE VARIABILITY 

A. Dependence of the variability on the averaging period 

Climate simulations are only expected to provide meaningful predictions for the temporal av¬ 
erages of the climate variables. In decadal climate predictions, the period for temporal averaging 
varies from one month to several years. The uncertainty in the prediction of the climate variables 
strongly depends on the averaging period. This dependence is illustrated in Figure]^ In this figure, 
the 30-year averages of the total, model and internal variabilities are presented for four different 
averaging periods: 1, 3, 6, and 12 months. The results in Figure]^ are for the dm anomalies, T'^ 
and U'^. 

As expected, the variability decreases for a longer averaging period. The sharpest decline oc¬ 
curs in the transition from the monthly to the seasonal averages. The decrease in the variability 
of the surface zonal wind (panel b of Figure is more significant than the decrease in the vari¬ 
ability of the surface temperature. The figure also shows that the sharp decrease in the variability 
is mainly due to the decrease of the internal variability. For the bias anomalies, the same trends 
are observed (not presented here), but the decrease in uncertainty is more significant because the 
internal variability constitutes a larger portion of the total uncertainty. 
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FIG. 3: Temporal and global averages of the total, model and internal variabilities of T'^ (panel a) and 
(panel b) (the dm anomalies of the surface temperature and zonal wind speed, respectively), for four 
different averaging periods (1,3,6 and 12 months). The temporal averages were calculated from the 30-year 
prediction period. 

B. Yearly averages of the variabilities 

The evolution of the uncertainties is of great importance. Naively, one would expect that the 
variability will grow with the lead time (the time since the initialization of the models). In order to 
study this evolution, we present, in Figure the global average of the variabilities of the annual 
mean anomalies of the surface temperature (left) and zonal wind (right) for the two anomaly 
definitions. The upper panels present the variabilities of the dm anomalies, and the lower panels 
show the variabilities of the bias anomalies. It is shown that the model variability is the main 
source of uncertainty in the dm anomalies, while the internal variability is responsible for most of 
the uncertainty in the bias anomalies. In addition, we found that the model variability of shows 
a moderate increase with time, unlike its internal variability, which is almost constant during the 
prediction period. The variabilities of show no clear trend during the prediction period except 
for the decrease of the model variability during the drift of the models from the initial condition to 


11 






Surface temperature 



Zonal wind 



0 5 10 15 20 25 30 

Years from 2006 


FIG. 4: Global averages of the internal, model and total variabilities of the annual means of surface temper¬ 
ature, T (left) and zonal wind U (right) anomalies. Panels (a,c) present the variabilities of the dm anomaly 
and panels (b,d) present the variabilities of the bias anomaly. 

their preferred climate. For the surface zonal wind, we found that both the internal and the model 
variabilities show no significant trend for either anomaly {U'^ or U^). Comparing the variabilities 
of the two anomalies (upper and lower panels), we found that the internal variability of the bias 
anomalies is about the same as that of the dm anomalies. However, the model variability of the 
bias anomaly is much smaller than that of the dm anomaly. The smaller model variability in the 
bias anomaly is expected because of the bias correction process. 


C. Intra-annual dynamics of the variability 

The previous subsections focused on the variabilities of the annual means and their evolu¬ 
tion. However, it is natural to expect that different months will have different contributions to 
the variabilities. We considered the monthly means of the surface temperature and zonal wind 
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FIG. 5: Global and temporal averages of the internal, model and total variabilities of the monthly means of 
surface temperature, T (left) and zonal wind U (right) anomalies. The temporal average of each calendar 
month was calculated from the 30-year prediction period. Panels (a,c) present the variabilities of the elm 
anomaly and panels (b,d) present the variabilities of the bias anomaly. The error bars represent two standard 
deviations calculated from the 30-year time series of the global average variance for each month. 

anomalies in order to investigate the intra-annual dynamics of the variabilities. The variabilities 
were averaged over the whole globe (the weight of each grid cell is proportional to the area it 
spans) and over the 30 years of the prediction period. Figure shows the global and 30-year 
average variabilities of the T and U anomalies for each of the calendar months. The error bars 
represent two standard deviations calculated from the 30-year time series of the global average 
variance for each month. The spatial variability of the variance for each month is presented in 
the Supplementary Materials. As expected, the variability of the monthly means is higher than 
the variability of the annual means. For example, the internal variability of the monthly means of 
is in the range of 1 — 2 °C‘^, whereas the internal variability of the annual means of T'^ is in 
the range of 0.1 — 0.3 °C‘^-a reduction of an order of magnitude. A smaller reduction is found 
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in the model variabilities. These findings indicate that we might predict the annual averages of a 
climate variable with a relatively small uncertainty, but this is only because the shorter time scale 
fluctuations are averaged out. The internal variability shows one significant peak during the north¬ 
ern hemisphere winter, whereas the model variability of the dm anomalies has two peaks: one 
(larger) in the northern hemisphere winter and one (smaller) in the northern hemisphere summer. 
One can also see that the bias anomalies have much smaller variabilities compared with the dm 
anomalies due to the bias correction. The error bars suggest that the inter-annual fluctuations in 
the uncertainty are larger for the zonal wind than for the surface temperature anomalies. 


V. REGIONAL PROPERTIES OE THE VARIABILITY 

The variability is not only affected by the averaging period and the season but it also strongly 
depends on the location and shows a large spatial variability. Figure|^shows the spatial distribution 
of the total variability, of the annual means of the dm anomalies. The variabilities presented 
correspond to the average variability during the 30-year prediction period. The upper panel shows 
the total variability of the surface temperature anomaly, T'^, and the lower panel shows the total 
variability of the surface zonal wind anomaly, W. The spatial variability is apparent for both 
climate variables. The variability of is larger in higher latitudes and in coastal regions, whereas 
the shows high variability mainly over the oceans. The topography also affects the variability, 
such as in the Andes and the Himalayas. 

To further analyze the role of the two main sources of variability (internal and model), we 
present, in Figure]^ the spatial distribution of the fraction of the model variability, The 

upper panel shows that the model variability constitutes the main part of the uncertainty associated 
with almost everywhere. The lower panel shows that over land, the model variability is also 
the main source of uncertainty, while over the oceans, it is smaller than the internal variability. 

Motivated by the results presented in Figure]^ we plotted the monthly average internal, model 
and total variabilities for four regions over the globe: (a) Land-North, (b) Land-South, (c) Ocean- 
North and (d) Ocean-South. The contributions of these regions to the global average variability 
(i.e., their relative surface area compared with the global surface area) are 19.5%, 9%, 30.5% 
and 41%, respectively. Figure shows that the main contribution to the global variability of 
comes from the land areas in the northern hemisphere. The contributions to the global averaged 
variability of of the northern hemisphere’s oceans and the southern hemisphere’s lands are both 
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FIG. 6: Temporal average of the total variability, a^, (in log scale) of the annual mean dm anomalies of 
(a) surface temperature, T'^, and (b) surface zonal wind, The temporal average was calculated from the 
30-year prediction period. 

comparable (and smaller than the contribution of the Land- North region), and the contribution of 
the southern hemisphere’s oceans, which constitute the largest region, is the smallest. 

The variabilities are shown in Figure]^ For the surface zonal wind, the two hemispheres’ 
oceans are the main sources of variability. The variability over land has a smaller contribution to 
the globally averaged variability with the smallest contribution coming from the southern hemi¬ 
sphere’s land areas. The model variability is higher over land compared with the internal variability 
as can be seen also in Figure [TJ^b). 

Figures and 1^ indicate that the internal variability is highest in winter in both hemispheres. 
However, the reason that only the peak during the winter in the northern hemisphere is visible in 
Figure is that the variability in the northern hemisphere winter is much larger than that during 
the southern hemisphere winter. For the surface temperature, it is the northern hemisphere’s land 
areas that control the profile of the annual cycle, while for the surface zonal wind, it is the balance 
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FIG. 7: The fraction of model variability from the total variability, , for (a) and (b) U^. 

between the northern and the southern hemispheres’ oceans that dictates the profile of the annual 
cycle. The two peaks observed in the globally averaged model variability of the surface tempera¬ 
ture (see Figure 1^ a)) are due to land areas in the northern hemisphere, while the two peaks in the 
globally averaged model variability of the surface zonal wind are mainly due to the oceans in both 
hemispheres. These peaks during the winter and summer indicate that the models have a larger 
disagreement in predicting the extreme climate conditions in these seasons. In the Supplementary 
Materials, we include full global variability maps for each of the months for in-depth analysis of 
the spatial distribution of the variability components. 


VI. SUMMARY AND DISCUSSION 

Meaningful climate predictions must be accompanied by uncertainties. While long-term cli¬ 
mate predictions focus on the response of the climate system to changes in the atmospheric compo¬ 
sition, decadal climate predictions attempt to provide synchronized climate predictions for shorter 
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FIG. 8: Temporal average of the internal, model and total variabilities for four domains-over land in 
the northern hemisphere, over land in the southern hemisphere, over ocean in the northern hemisphere, 
over ocean in the southern hemisphere. The temporal averages were calculated from the 30-year prediction 
period for each calendar month. The error bars represent two standard deviations calculated from the 30- 
year time series of the global average variance for each month. 

periods. Therefore, the meaningful climate variables differ by the averaging period. For example, 
in decadal climate predictions, seasonal and annual means are expected to be synchronized with 
the actual dynamics, while for long-term climate predictions, only the decadal (or longer averaging 
periods) means are expected to be relevant. The main sources of uncertainty in decadal climate 
predictions are the model variability and the internal variability, reflecting the sensitivity of the 
models to the initialization method and the differences between parameterization schemes for pro¬ 
cesses that are not explicitly resolved by the models. A common practice in analyzing climate 
prediction is to apply “bias correction” procedures in order to overcome known tendencies of the 
models to simulate an average climate state, which is shifted from the observed one by a constant 
amount (often the global temperature is higher or lower than the measured one). However, the bias 
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FIG. 9: Temporal average of the internal, model and total variabilities for four domains-over land in 
the northern hemisphere, over land in the southern hemisphere, over ocean in the northern hemisphere, 
over ocean in the southern hemisphere. The temporal averages were calculated from the 30-year prediction 
period for each calendar month. The error bars represent two standard deviations calculated from the 30- 
year time series of the global average variance for each month. 


correction assumes that the climate dynamics predicted by the models is not affected by the bias. 
Moreover, this correction is applied as an empirical correction rather than relying on a physical 
basis. The variety of bias correction methods is the reason that a well-defined anomaly that is 
eonsidered as the meaningful predietion of the models does not exist. 

Here, we used an ensemble of the CMIP5 decadal predictions, focusing on two definitions of the 
anomaly. The dm anomaly does not involve any bias eorreetion, simply shifting the predictions to 
reflect the deviations from the NCEP reanalysis climatology of the 30 years prior to the simulated 
period. The bias anomaly involves bias correction, reflecting the deviation of each model from 
its own climatology during the last 20 years of the prediction period. The choice of the model 
elimatology only 10 years after the initialization was motivated by the observation that the first 
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several years are strongly affected by the model’s drift. In the Supplementary Materials, we also 
present the results for a third definition of the anomaly in which the deviations of each model from 
the climate it predicted for the year 2016 are considered. The uncertainties were decomposed to 
those existing due to the models’ sensitivity to initialization methods and initial conditions, the 
internal variability, and the variability between different models. The definition of the variability 
ensured that the contributions of the internal and the model variabilities are independent and that 
the total ensemble variability is the sum of these two contributions. 

We showed that the variability of the CMIP5 decadal predictions does not increase significantly 
with time. For the bias anomaly, most changes occur during the drift period, while for the dm 
anomaly, there are no significant changes. The results for the internal variability are in agree¬ 
ment with previous results for the long-term experiments of the CMIP3 ll3^[3^ . However, in the 
decadal experiments of the CMIP5, we have not seen the increase in model variability that was 
found in the CMIP3 data |l32l |34]|. The differences might be related to the different averaging 
periods (decadal in ll32l[34ll and, at most, annual in our work), different spatial resolutions (global 
and 15° X 15° resolutions in ll^l34ll and 2.5° x 2.5° in our work) and, in particular, to the different 
nature of decadal climate predictions compared with long-term climate predictions. 

The predictions and, in particular, the uncertainties strongly depend on the definition of the 
anomaly. Bias correction reduces the model variability by subtracting a different climatology from 
each model. In addition, the uncertainties also depend on the averaging period. The variability 
of the monthly means is much larger than that of the annual means. The significant reduction in 
the variability is seen in the transition from monthly means to seasonal (3 months) means. The 
model variability is more sensitive to the annual cycle than the internal variability. The relative 
importance of the model and internal variabilities depends on the definition of the anomaly; for 
the dm anomalies, the model variability is larger than the internal variability and vice versa for 
the bias anomaly. By analyzing the spatial distribution of the variabilities, we showed that the 
land areas in the northern hemisphere are the main source of uncertainty in surface temperature, 
while the oceans in both hemispheres are responsible for most of the variability of the surface 
zonal wind. Previous results ll3^ showed no clear distinction between the contributions of land 
and ocean areas but rather a latitude dependence of the variabilities. Some of the spatial patterns 
of the internal variability that we found for the surface temperature, such as the increased internal 
variability toward the poles, are in agreement with previous works ll^ . However, the spatial 
patterns of the variabilities of the surface wind are different and were not presented in previous 
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works. 


The results presented here suggest that the modeling of the climate dynamics in the mid¬ 
latitudes should be improved. Such an improvement is expected to reduce the uncertainty of 
surface temperature, which is mostly due to the mid-latitude land areas in the northern hemi¬ 
sphere. The predictions of the surface zonal wind over the oceans should be improved as well. 
Obviously, the uncertainty in winter is the largest due to storms and extreme climate conditions. 
A weighted ensemble of climate models may significantly reduce the uncertainties by weighting 
each of the models according to its past performance. The contribution of the model variability 
may be significantly reduced this way. However, a reduction of climate prediction uncertainties 
does not necessarily lead to improved forecast quality. A reduction of the uncertainties without 
any improvement of the predictions can lead to a situation in which all the models predict similar 
dynamics that do not span the measured state of the climate system, and thus, the ensemble is 
not reliable (or is overconfident). A reduction of climate variability must be associated with an 
improvement in climate predictions. 
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Appendix A: Alternative definition of the anomaly-deviations from the 2016 climatology 

In the main text, we showed that the variabilities of the decadal climate predictions strongly 
depend on the definition of the anomalies. Here, we present the analysis of the variabilities of an 
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additional definition. Here, the anomaly is defined to be the deviation from the climatology of 
2016. The idea behind choosing 2016 is that 10 years after the initialization of the models, the 
effects of the drift are expected to be negligible. This anomaly is defined as: 

y^r (t) = Ym,r (t) - (t TUOd 12) , (Al) 

where Ym,r (t) is the prediction of the rth realization of model m for time t (in our analysis, t 
measures a discrete number of months, and the variable Y is either the surface temperature, T, 
or the surface zonal wind, U) and (*) is the monthly mean of the variable Y during month 
i of 2016 (i e [0,11]; i = 0 corresponds to December and i = 1... 11 correspond to January- 
November, respectively) as predicted by the realization r of model m. In what follows, we refer 
to this definition as the 2016 anomaly and use the superscript s to denote it. 

The time series of the surface temperature and zonal wind anomalies are presented in Figure 
The variabilities of the annual means of the 2016 anomalies are presented in Figure[^ Figure [T^ 
depicts the variabilities of the monthly means. The variability of each calendar month is averaged 
over the 30 years of the prediction period, and the error bars represent two standard deviations. 

Appendix B: Meridional wind anomalies and their variabilities 

This section presents the analysis of the surface meridional wind anomalies and their vari¬ 
abilities. The analysis is similar to the analysis presented in the main text for the surface zonal 
wind. Figure [^presents the global and annual averages of the surface meridional wind anoma¬ 
lies. These anomalies are of the same order of magnitude as those found for the surface zonal 
wind. Figure [^presents the variabilities of the global and annual averages of V. The variabili¬ 
ties are a little smaller than those found for U. Figure [T^ depicts the annual cycle of the surface 
meridional wind variabilities. Also for this variable, we found that the model variability is more 
influenced by the annual cycle. The maximal variability is found during the winter in the northern 
hemisphere. However, for the bias-corrected anomalies, the peak is much lower due to the smaller 
contribution of the model variability. The spatial distribution of the total variability of and the 
fraction of the model variability are presented in Figures [T^ and [T^ The variability is larger over 
the oceans (similar to the surface zonal wind). Over land, the model variability is larger, while 
over the oceans, the internal variability dominates. Figure [^presents the temporal average of the 

internal, model and total variabilities for four domains-over land in the northern hemisphere. 
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FIG. 10: Global and annual averages of (a) T/ and (b) as predicted by the models of the ensemble (each 
model is averaged over its realizations). The curves present the predicted values minus the 2016 predictions 
of each model. The factor subtracted is different for each model and represents a bias correction. Surface 
temperature anomalies have a large spread between models during the first 10 years associated with the drift 
of the models to their climatology. In 2016, by definition, all the anomalies are zero. The spread between 
models after the first 10 years is smaller and increases with time. The surface zonal wind anomalies show 
no considerable change between the first 10 years of the predictions and the last 20 years. 

over land in the southern hemisphere, over ocean in the northern hemisphere and over ocean in the 
southern hemisphere. The temporal averages were calculated from the 30-year prediction period 
for each calendar month. The error bars represent two standard deviations calculated from the 30- 
year time series of the global average variance for each month. The oceans in both hemispheres 
are the main sources of variability. 
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FIG. 11: Global averages of the internal, model and total variabilities of the annual means of the surface 
temperature, (left) and zonal wind (right) anomalies. Both panels present the variabilities of the 2016 
anomaly. There are no considerable trends in the variability that can be observed, except for a small trend 
during the first 10 years of the predictions, which could be associated with the drift of the models to their 
climatology. 



FIG. 12: Global and temporal averages of the internal, model and total variabilities of the monthly means of 
surface temperature, (left) and zonal wind (right) anomalies. The temporal average of each calendar 
month was calculated from the 30-year prediction period. Both panels present the variabilities of the 2016 
anomaly. The error bars represent two standard deviations calculated from the 30-year time series of the 
global average variance for each month. The variabilities have one annual peak in the northern hemisphere 
winter (for the zonal wind, the peak is fairly small). 
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FIG. 13: Global and annual averages of Vt as predicted by the models of the ensemble (each model is 
averaged over its realizations). The curves present the predicted values based on the (a) dm, (b) bias, and 
(c) 2016 anomalies. No significant trend is observed. 

Appendix C: Spatial distribution of the monthly mean variabilities for each calendar month 

In the main manuscript, the variabilities of the monthly means in four regions are presented. 
Here, we extend the analysis to show the full spatial distributions of the model and internal vari¬ 
abilities of the surface temperature, zonal wind and meridional wind dm anomalies. The variabil¬ 
ities presented were derived from the temporal average, for each calendar month, of the 30 -year 
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FIG. 14: Global averages of the internal, model and total variabilities of the annual means of (a) dm, (b) 
bias, and (c) 2016 surface meridional wind anomalies. Both bias corrections (the bias and 2016 anomalies) 
significantly decrease the model variability. 

prediction period. Figures and [^present the variabilities of the surface temperature anomaly. 
Figures f2l\ and [^present the variabilities of the surface zonal wind anomaly, and Figures and 
[^present the variabilities of the surface meridional wind anomaly. 
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FIG. 15: Global and temporal averages of the internal, model and total variabilities of the monthly means 
of the surface meridional wind anomalies, (a) dm, (b) bias and (c) 2016. 
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FIG. 16: Spatial distribution of the temporal average of the total variability, a^, (in log scale) of the annual 
mean dm anomalies of surface meridional wind, V^. The temporal average was calculated from the 30-year 
prediction period. High variability is observed mainly over the oceans. 



FIG. 17: Spatial distribution of the fraction of model variability from the total variability, I , for V^. 
Model variability is the main source of uncertainty over land, while the internal variability is larger over the 
oceans. 


31 



































Land-North 


Ocean-North 



Calendar month 

Land-South 



Ocean-South 




FIG. 18: Temporal average of the internal, model and total variabilities for four domains-over land in 
the northern hemisphere, over land in the southern hemisphere, over ocean in the northern hemisphere and 
over ocean in the southern hemisphere. The temporal averages were calculated from the 30-year prediction 
period for each calendar month. The error bars represent two standard deviations calculated from the 30- 
year time series of the global average variance for each month. The oceans in both hemispheres are the 
main sources of variability. 
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FIG. 20: Spatial distribution of model variability for each calendar month. 
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FIG. 21: Spatial distribution of internal variability for each calendar month. 
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FIG. 24: Spatial distribution of model variability for each calendar month. 
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